Automatic Smoothing for Discontinuous Regression Functions
نویسندگان
چکیده
This article proposes an automatic smoothing method for recovering discontinuous regression functions. The method models the target regression function with a series of disconnected cubic regression splines which partition the function’s domain. In this way discontinuity points can be incorporated in a fitted curve simply as the boundary points between adjacent splines. Three objective criteria are constructed and compared for choosing the number and placement of these discontinuity points as well as the amount of smoothing. These criteria are derived from three fundamentally different model selection methods: AIC, GCV and the MDL principle. Practical optimization of these criteria is done by genetic algorithms. Simulation results show that the proposed method is superior to many existing smoothing methods when the target function is non-smooth. The method is further made robust by using a Gaussian mixture approach to model outliers.
منابع مشابه
Optimal Smoothing for Pathwise Adjoints
We propose an optimal smoothing parametrization for gradient estimators of expectations of discontinuous functions. The reparametrization trick with discontinuous functions gives gradient estimators for discrete random variables [5, 8, 13] and makes smoothing applicable in the machine learning context (e.g. variational inference and stochastic neural networks [11, 1, 12, 6]). Our approach is ba...
متن کاملUse of Two Smoothing Parameters in Penalized Spline Estimator for Bi-variate Predictor Non-parametric Regression Model
Penalized spline criteria involve the function of goodness of fit and penalty, which in the penalty function contains smoothing parameters. It serves to control the smoothness of the curve that works simultaneously with point knots and spline degree. The regression function with two predictors in the non-parametric model will have two different non-parametric regression functions. Therefore, we...
متن کاملUse of Input Deformations with Brownian Motion Filters for Discontinuous Regression
Bayesian Gaussian processes are known as ‘smoothing devices’ and in the case of n data points they require O(n) . . . O(n) number of multiplications in order to perform a regression analysis. In this work we consider one-dimensional regression with Wiener-Lévy (Brownian motion) covariance functions. We indicate that they require only O(n) number of multiplications and show how one can utilize i...
متن کاملLocally adaptive Bayesian P-splines with a Normal-Exponential-Gamma prior
The necessity to replace smoothing approaches with a global amount of smoothing arises in a variety of situations such as effects with highly varying curvature or effects with discontinuities. We present an implementation of locally adaptive spline smoothing using a class of heavy-tailed shrinkage priors. These priors utilize scale mixtures of normals with locally varying exponential-gamma dist...
متن کاملOn Automatic Boundary Corrections*
Many popular curve estimators based on smoothing have diicul-ties caused by boundary eeects. These eeects are visually disturbing in practice and can play a dominant role in theoretical analysis. Local polynomial regression smoothers are known to correct boundary eeects automatically. Some analogs are implemented for density estimation and the resulting estimators also achieve automatic boundar...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001